Virtual trauma patient simulation design using the McGill Simulation Complexity Score (MSCS): a breakthrough in trauma education.

BACKGROUND: Virtual patient simulations are interactive, computer-based cases. We designed scenarios based on the McGill Simulation Complexity Score (MSCS), a previously described objective complexity score. We aimed to establish validity of the MSCS and introduce a novel learning tool in trauma education at our institution. METHODS: After design of an easy and difficult patient scenario, we randomized medical students and residents to each perform 1 of the 2 scenarios. We conducted a 2-way analysis of variance of training level (medical student, resident) and scenario complexity (easy, difficult) to assess their effects on virtual time, the number of steps taken in the scenario, beneficial and harmful actions, and the ratio of beneficial over harmful actions. RESULTS: Virtual patient scenarios were successfully designed using the MSCS. Twenty-four medical students and 12 residents participated in the easy scenario (MSCS = 3), and 27 medical students and 12 residents did the difficult scenario (MSCS = 18). Though beneficial actions were similar between students and residents, sudents performed more harmful actions, particularly when the scenario was difficult. One virtual patient died in the easy scenario and 3 died in the difficult one (all medical students). Performance varied with level of complexity and there was significant interaction between level of training and number of steps, as well as with number of harmful actions. Decreasing performance with increasing level of complexity, as defined by the MSCS, suggests this score can accurately quantify difficulty. CONCLUSION: We established validity of the MSCS and showed its successful application on virtual patient scenario design.

Development of an evidence-based educational resource in oncology: 'Living safely with bone metastases'.

Objective: To create an evidence-based patient education resource to better support cancer patients with bone metastases in carrying out safe movements during activities of daily living, to maintain their bone health and reduce the risk of fractures. Methods: A quality improvement project was conducted in three phases: Development of the Resource, Preliminary Feedback and Revision, and French Canadian Translation. Results: The educational resource Living Safely with Bone Metastases focuses on safe movement, activities of daily living, and exercise, organized within the sections Move with care, Stay safe in different environments and Follow an exercise program prescribed by a physiotherapist. Translation yielded a Canadian French version Vivre en toute sécurité avec des métastases osseuses. Conclusion: Living Safely with Bone Metastases is an accessible online and paper resource for patients and healthcare professionals, in order to promote ongoing disease management of individuals with bone metastases. Innovation: Cancer patients with bone metastases are at high risk of pathological fractures however resources on fracture prevention are lacking. Living Safely with Bone Metastases is an innovative health education resource that fills an important gap in oncology practice and has the potential to reduce the occurrence of fractures.

Objective Assessment of the Entrustable Professional Activity Handover in Undergraduate and Postgraduate Surgical Learners.

OBJECTIVE: This study used a virtual patient simulation (VPS) to quantifiably and objectively assess undergraduate (UG) to postgraduate (PG) medical learners' acquisition of the entrustable professional activity (EPA) "handover," focusing particularly on the transition to residency. This EPA is critical because it is part of a core competency for UG and PG training in both the United States and Canada, and is essential for patient safety and comprehensive professional communication. DESIGN: Data were collected from 3 separate groups of participants: 2 UG cohorts from an earlier study, as well as a PG cohort at the beginning of residency. All participants completed the same trauma VPS, which required a free text summary statement that was used as a surrogate for an oral handover. These were collected and scored independently, using previously developed validated rubrics, one procedural and the second semantic. SETTING: All study participants were from one site. The VPS case was completed online. PARTICIPANTS: Two different UG groups, one designated junior (N = 52), was studied at the beginning of their clerkship year, a second group, designated senior (N = 30), was studied at the end of their clerkship year. These groups were compared to a third group of PG learners (N = 31) during the initial 2 weeks of their residency. Informed consent was obtained from all participants. RESULTS: A procedural rubric assessed learners' cognitive knowledge of trauma care-management. A semantic rubric assessed their use of the professional language necessary for a safe and succinct clinical handover communication. An Analysis of Variance comparing scores on the procedural rubric was highly significant with Tukey LSD tests indicating that all 3 groups were significantly different. Students increased their scores on the procedural rubric at each stage of their training. A parallel Analysis of Variance comparing students' scores on the semantic rubric revealed no significant increase in scores, indicating that students did not improve in their capacity to communicate professionally as they progressed through their training. CONCLUSIONS: Taken together, these results demonstrate that training was successful in teaching cognitive-based procedures, but not effective in teaching professional communication, which is critical to the EPA handover. Greater emphasis needs to be placed on ensuring the acquisition of professional communication skills throughout the continuum of UG and PG clinical activities. Faculty development should serve as a support to assist medical educators to address this requirement. These results also demonstrate that VPS with associated objective and validated rubrics can be used as an assessment methodology to quantifiably measure learner performance with respect to the EPA handover. A similar strategy should be considered across the UG and PG continuum for other EPAs and could form the nexus for further research.

Creation and Pilot-testing of Virtual Patients for Learning Oncologic Emergency Management.

Purpose or objective Management of oncologic emergencies becomes critical at the start of the second year of a radiation oncology residency. Considering the limited exposure to oncology in the medical school curriculum, this knowledge gap needs to be filled prior to managing real patients. The aim of this project was to create virtual patients (VPs) to ease this transition and improve learner readiness for independently managing oncologic emergencies on call. Material and methods A curriculum mapping exercise was done to identify gaps. The main oncologic emergencies that needed to be addressed were selected for development of the modules. Review of the key concepts for management was elucidated and validated. These included history, physical examination, imaging interpretation, staging, as well as anatomy, epidemiology, pertinent literature, differential diagnosis, prognostication, radiation treatment planning, summarizing, and patient- and peer-communication skills. Clinical vignettes were then designed, in collaboration with a virtual patient education expert, to mimic the clinical presentation and evolution of a typical patient for three common oncologic emergencies: spinal cord compression, superior vena cava syndrome, and tumor-induced hemorrhage. Results Three virtual modules were developed: spinal cord compression, superior vena cava syndrome, and tumor-induced hemorrhage. Each case included 25 to 30 vignettes that participants progressed through, with a total estimated completion time of 30 to 45 minutes. Each node branched out to provide a detailed answer and explanation of the key concept. Figures were included to mimic real patients and to provide a more authentic learning experience. The modules also included quantitative pre- and post-testing assessments, including multiple-choice questions, true or false, fill in the blank, short answers, and text response. The cases were then transcribed onto a virtual patient simulation platform. Following completion of the module, a report was generated for each individual learner to track all responses and used as the assessment tool. The pilot test showed an increase of 28% in the pre-to-post-test results in a cohort of nine residents. The mean pre-test result of 58% increased to a mean post-test result of 86% (range: 70-100%) after completing the three modules. Conclusion VPs can be used for learning the management of oncologic emergencies and can be done on a simulation-based learning platform. The modules can be used as both, a learning and an assessment tool for junior residents. The results of the pilot test show a significant improvement in knowledge acquisition between pre- and post-test scores after completion of the three modules.

Identifying high quality medical education websites in Otolaryngology: a guide for medical students and residents.

BACKGROUND: Learners often utilize online resources to supplement formalized curricula, and to appropriately support learning, these resources should be of high quality. Thus, the objectives of this study are to develop and provide validity evidence supporting an assessment tool designed to assess the quality of educational websites in Otolaryngology- Head & Neck Surgery (ORL-HNS), and identify those that could support effective web-based learning. METHODS: After a literature review, the Modified Education in Otolaryngology Website (MEOW) assessment tool was designed by a panel of experts based on a previously validated website assessment tool. A search strategy using a Google-based search engine was used subsequently to identify websites. Those that were free of charge and in English were included. Websites were coded for whether their content targeted medical students or residents. Using the MEOW assessment tool, two independent raters scored the websites. Inter-rater and intra-rater reliability were evaluated, and scores were compared to recommendations from a content expert. RESULTS: The MEOW assessment tool included a total of 20 items divided in 8 categories related to authorship, frequency of revision, content accuracy, interactivity, visual presentation, navigability, speed and recommended hyperlinks. A total of 43 out of 334 websites identified by the search met inclusion criteria. The scores generated by our tool appeared to differentiate higher quality websites from lower quality ones: websites that the expert "would recommend" scored 38.4 (out of 56; CI [34.4-42.4]) and "would not recommend" 27.0 (CI [23.2-30.9]). Inter-rater and intra-rater intraclass correlation coefficient were greater than 0.7. CONCLUSIONS: Using the MEOW assessment tool, high quality ORL-HNS educational websites were identified.

A Learner-Created Virtual Patient Curriculum for Surgical Residents: Successes and Failures.

OBJECTIVE: To determine the feasibility and effectiveness of a learner-created virtual patient (VP) curriculum for postgraduate year 2 surgical residents. DESIGN: Using a social-constructivist model of learning, we designed a learner-created VP curriculum to help postgraduate year 2 residents prepare for their in-training surgical examination. Each resident was assigned to create a VP curriculum based on the learning objectives for this examination, and VP cases were then disseminated to all residents for completion. To measure the learning effects of the curriculum, participants completed 2 simulated in-training examinations, both at the beginning and at the end of the intervention. Study participants also participated in a focus group and completed an online questionnaire about the perceived learning value of the curriculum. SETTING: The study was conducted at the McGill University Health Centre, a tertiary care hospital in Montreal, Canada. PARTICIPANTS: In total, 24 residents from 7 surgical specialties completed both the pretest and posttest, as well as took part in the creation of a VP curriculum. Of those 24 residents, only 19 residents completed the cases created by their peers, with 7 completing greater than 50% of the cases and 12 completing less than 50%. In all 17 residents responded to the online questionnaire and 11 residents participated in the focus group. RESULTS: The VP curriculum failed to improve scores from pretest (59.6%, standard deviation = 8.1) to posttest (55.4%, standard deviation = 6.6; p = 0.01) on the simulated in-training examination. Nonetheless, survey results demonstrated that most residents felt that creating a VP case (89%) and completing cases created by their peers (71%) had educational value. Overall, 71% preferred active participation in a curriculum to traditional didactic teaching. The focus group identified time-related constraints, concern about the quality of the peer-created cases, and questioning of the relationship between the curriculum and the Surgical Foundations examination as barriers to the success of the curriculum. CONCLUSIONS: Despite the fact that a learner-created VP curriculum did not improve scores on a mock in training examination, residents viewed this intervention as a valuable educational experience. Although there were barriers to the implementation of a learner-created curriculum, it is nonetheless important to try and integrate pedagogical concepts into the instructional design of curricula for surgical residents.

Developing an interprofessional care plan for an older adult woman with breast cancer: from multiple voices to a shared vision.

Interprofessional collaboration is central to quality patient care; however, little is known about developing interprofessional care plans, particularly in oncology. This article describes the development of an interprofessional care plan for an older adult woman with breast cancer. Two collaborative expert workshops were used; 15 clinical experts reviewed an online patient case and were asked to prepare a uniprofessional care plan. In workshop 1, participants worked from a draft interprofessional care plan, synthesized from the uniprofessional care plans by research associates, to arrive at consensus on an ideal interprofessional care plan. Using qualitative inductive content analysis of workshop transcripts, specific changes and overall key principles were identified and used to revise the draft plan. Based on these findings, a generalized interprofessional care plan/oncology model was developed. Revisions and proposed model were validated through consensus by participants during workshop 2. Participants highlighted the iterative, cyclical, and multilayered nature of patient care experiences; the importance of central patient profiles, which are contributed to and validated by all healthcare professionals; and the importance of assessing patient understanding. Participation of a patient representative provided an invaluable contribution. The process and model provide a unique framework for interprofessional care plan development in other settings and patient populations.